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Advanced  Weapons L 

Line  of  sight/beyond  line  of  sight  fire;  non  line  of  sight  fire;  scalable  effects;  non-lethal;  directed  energy;  autonomous  weapons 

Ammunition: 

Small,  medium,  large  caliber;  propellants;  explosives;  pyrotechnics;  warheads;  insensitive  munitions;  logistics;  packaging;  fuzes; 
environmental  technologies  and  explosive  ordnance  disposal 

Fire  Control: 

Battlefield  digitization;  embedded  system  software;  aero  ballistics  and  telemetry 


ARDEC  provides  the  technology  for  over  90%)  of  the  Army  s  lethality  and  a  significant  amount  of  support  for 

other  services  ’  lethality 
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Military  Need  for  Squad  Performance  Evaluation 


•  ARDEC  seeks  to  improve 
Soldier/Squad;  lethality, 
survivability,  and  mobility 

•  Trade-off  analysis  are  necessary 
to  produce  the  most  effective 
Soldier 

•  Group-level  metrics  are  desired 
to  measure  squad  performance 

•  Materiel  evaluation  will  help  to 
achieve  optimum  squad 
performance 
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Introduction 


Performance  Evaluation  at  TBRL 


•  Performance  of  individual  Soldiers  using  ARDEC  systems 


•  Performance  of  Non-Lethal  Weapons  against  targets 
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The  Squad  Performance  Test  Bed 


Goals  for  Squad  Performance  Test  Bed  ( SPTB ) 


•  Operationally  relevant  metrics  for  squad  and  individual  Soldiers 

•  Measures  of  Effectiveness  (MoE) 

•  Measures  of  Performance  (MoP) 

•  Incorporate  metrics  and  measures  into  modeling  and  simulation 

•  Human  factors  that  impact  candidate  materiel  solutions 

•  Squad-level  behavioral  response  to  candidate  materiel 

•  Paradigm  to  test,  record,  and  assess  effects  of  psychosocial 
variables  in  personnel 

•  Situational  Awareness 

•  Leadership 

•  Training 

•  Cohesiveness 
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Outdoor  SPTB  -  Environment 


•  700  x  500  meters 
over  hilly,  grassy, 
and  wooded  terrain 

•  Configured  for  React 
to  Contact  Battle  Drill 
scenario 

•  Instrumented  to 
capture  behaviors  of 
collective  teams 

•  Location  tracking 

•  Battlefield  effects 
simulation 
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Outdoor  SPTB  -  Instrumentation 


•  Location  Tracking  System 

•  Ubisense  Real-Time  Location  Tracking  System  (RTLS) 

-  Ubisense  Series  7000  sensors  &  tags 

-  Tags  worn  by  team  members  as  the  maneuver  test  bed 

-  Computer  system 


•  Displays  &  2-D  or  3-D  graphs  of  Soldiers  path  as  traveled 
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Outdoor  SPTB  -  Instrumentation 


•  Video  recording  systems 

•  IP  cameras  &  computer  system 

-  Display  &  record  Soldiers  within  the  test  bed 

•  Personal  worn  cameras 

-Record  communicable  behaviors  &  first  person  perspective 

•  Battlefield  effect  simulation 

•  Machine-gun  enemy  fire  simulated  using  pyrotechnics 

-COPAS  Micro  Pyro  System 

•  Controller  Unit,  Launcher,  and  Pyrotechnic  rounds 
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Outdoor  SPTB  -  Instrumentation 


•  Weapon  system  &  rounds  simulation 

•  Real  weight  replicas  of  squad  hand-carried  weapons 

•  Airsoft  Automatic  Electric  Guns  (AEG) 

•  Lab  VIEW  software 

•  Triggering  &  recording  events 

-Synchronize  target  presentation 
-Synchronize  battlefield  effects 
-Shooter  performance 
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The  Squad  Performance  Test  Bed 


Indoor  SPTB  -  Environment 


Flash-bang  range,  two  rooms  and  a 
courtyard  for  room  entry  scenarios 

Simulate  Close  Quarters  Battle  (CQB) 

Modular  room  to  test  right,  left,  and 
center  fed  rooms 

Motion  capture  technology 
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Indoor  SPTB  -  Instrumentation 


Motion  capture  system 

•  Uniquely  configured 
Retro-reflective  markers 

•  Vicon  MoCap  cameras 


Computer  system  that 
displays  and  records 
Soldier  location  data  with 
6  degree  of  freedom 
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The  Squad  Performance  Test  Bed 


Indoor  SPTB  -  Instrumentation 


•  Video  recording  systems 

•  IP  camera  system 

•  Personal  worn  cameras - 

•  Weapon  system  &  rounds  simulation 

•  Airsoft  AEG  weapons 

•  Lab  VIEW  software 

•  Triggering  &  recording  events 


-  Synchronized  target  presentation 


-  Shooter  performance 


Behavior  Coding  Process  -  Codebook 


Capturing  behaviors 
of  interest 

-  Noldus  Observer  XT 
11.5  behavior  coding 

•  Behavior  codebook 

•  Import  multi¬ 
camera  views 

•  Code  behaviors  of 
interest 

•  Perform  analysis 
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Measuring  Performance 


SPTB  -  Behavior  Codebook 


•  Deriving  behaviors  of  interest 

-  Gain  understanding  of  most  relevant  behaviors 

•  Interviews  with  Soldier  trainers 

•  Examining  training  doctrine  of  battle  drills 

•  Group  list  of  behaviors  in  categories 

•  Subject  matter  expert  confirmation 
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Measuring  Performance 


SPTB  -  Behavioral  Coding 


•  Example  behaviors  of  interest 

-  Response  to  simulated  attack  of  enemy  forces 

•  Locomotive  behaviors 

-  Formation  during  cover  &  advancement 

-  Distance  between  Soldiers 

•  Communicable  behaviors 

•  Use  of  force 

-  Room  entry  &  clearing 

•  Locomotive  behaviors 

-  Movement  to  designated  area  of  rooms 

-  Movement  in  side  and  center  fed  doorways 

•  Communicable  behaviors 

•  Interaction  with  hostile  and  non-hostile  targets 

•  Use  of  force 
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Measuring  Performance 


Behavior  Coding  Process  -  Video  Synchronization 


G3 

File  Edit  View  Setup  Observe  Analyze  Help 
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Measuring  Performance 


Behavior  Coding  Process  -  Event  Log 


•  Recording  behaviors  of 
interest 

-  Event  Log  tracks  all 
coded  behavior  on  a 
timeline  table 

-  Visualization  graph 
displays  behavior  coded 
per  category 
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Visualization  -  A_Teaml_Building  Approach  . 


behavior 

occurred 


itivJ  Time 

(s.ff)  0.00 


Indicates  what  behavior  occur 
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Results 
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Use  the  Event  Logs  to  get  more  detail  about  the  Visualizations. 

Match  the  "RelativeTime"  of  the  start  of  the  behavior  box  to  the  "Time  Point"  on  the  Event  Log. 
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Behavioral  Analysis  Example 


•  Analyzing  behaviors  of 
interest 

-  Team  analysis  focusing 
on  Communication, 
Muzzle  Discipline  and 
Weapon  Usage 

-  Produce  timeline 
visualization  of  behaviors 

-  Descriptive  statistics  with 
plots  or  results 

-  Export  data  for  qualitative 
analysis 


Behavior  Directed  Toward: 

tQ)  Dispatch 
®  Injured  Victim 
EH  Other  Officer 
HI  Perpetrator 

■  Stu  dent/ Staff 

■  Team  Member 

D  Utikno  vvn/Uni  d  e  ntifi  ed 
H  Weapon 

■  Whole  Team 


TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


UNCLASSIFIED 


20 


•  Similar  testing  conducted  with  police  teams  show  successful 
development  and  evaluation  of  MoP  using  location  tracking  system, 
video  recording  systems,  and  behavioral  coding  techniques 

•  Preliminary  testing  at  the  TBRL  SPTB  allowed  assessment  of  the 
development  and  testing  process  which  led  to  refinement  of  the  test 
bed  design  plans 

•  Lessons  learned  from  preliminary  testing  and  police  testing  are 
being  incorporated  in  the  SPTB  test  plan 

•  Future  plans  include  completion  and  full  testing  of  the  SPTB 

•  Upon  completion  of  the  SPTB,  ARDEC  and  other  groups  will  be  able 
to  evaluate  MoP  &  MoE  for  individual  Soldiers  and  squads 
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^Preliminary  building  and  testing  of  indoor  and  outdoor  test  bed  to 
compare  performance  of  Soldiers  and  squads 

S  Determine  location  tracking  system  sensor  configuration 
S  Test  video  recording  systems 
S  Acquire  materials  and  gear  for  soldier  testing 
S  Acquired  safety  and  environmental  approvals 

^Evaluation  of  team  and  individual  behaviors  using  codebook 
^Development  of  a  behavioral  codebook  for  battle  teams 
^Behavior  coding  of  teams  and  individuals 
^Behavior  analysis  of  teams  and  individuals 

•  Test  and  evaluate  change  in  performance  with  and  without 
candidate  materiel  solutions  to  enhance  squad  lethality,  survivability, 
and  mobility 


TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


UNCLASSIFIED 


22 


1 .  http://nsrdec.natick.army.mil/facilities/index.htm.  05/02/2014 

2.  http://usarmy.vo.llnwd.nete2cimages20121030269965original.jpg.  05/06/2014 

3.  E.  Mezzacappa,  G.  Cooke,  G.  Reid,  R.  DeMarco,  C.  Sheridan,  &  J.  Riedener. 
Data-Driven  Modeling  of  Target  Human  Behavior  in  Military  Operations.  Behavioral 
Representation  In  Modeling  &  Simulation  Poster  Presentation.  2012 

4.  http://www.bing.eom/maps/#Y3A9NDAuOTM3MzAyfi03NC41ODM2MDMmbHZsPT 
Qmc3R5PXImcT1QaWNhdGlubnklMjBBcnNlbmFsJTJDJTIwTmV3JTIwSmVyc2V5 
JTJDJTIwVW5pdGVkJTIwU3RhdGVz.  01/31/2013 

5.  http://www.airsoftatlanta.com.  05/05/2014 

6.  Reid,  G;  Mezzacappa,  E;  Cooke,  G;  Tevis,  K;  DeMarco,  R;  Reidener,  J.  Active 
Shooter  Training  Evaluation:  West  Orange  Police  Department  (TBRL-WOASTR- 
14-001).  Picatinny  Arsenal,  NJ:  Target  Behavioral  Response  Laboratory.  2014 


TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


UNCLASSIFIED 


23 


US,  ARMY 


vi#«  nrwvr 

RDECOM 


Target  Behavioral  Response  Laboratory 
MORSS  Presentations 


•  Virtual  Employment  Test  Bed:  Operational  Research  and  Systems  Analysis  to 
Test  Armaments  Designs  Early  in  the  Life  Cycle 

•  Method  and  Process  for  the  Creation  of  modeling  and  Simulation  Tools  for  Human 
Crowd  Behavior 

•  Squad  Modeling  and  Simulation  for  Analysis  of  Materiel  and  Personnel  Solutions 

•  The  Squad  Performance  Test  Bed 

•  Crowd  Characteristics  and  Management  with  Non-Lethal  Weapons:  A  Soldier 
Survey 

•  Effectiveness  Testing  and  Evaluation  of  Non-lethal  Weapons  for  Crowd 
Management 

•  Effects  of  Control  Force  Number,  Threat,  And  Weapon  Type  on  Crowd  Behavior 
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Questions? 


US  Army  -  Target  Behavioral  Response  Lab 


Mr.  Gladstone  V.  Reid  Jr. 
Picatinny  Arsenal,  NJ 
gladstone.v.reid.civ@mail.mil 
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BACKUP  SLIDES 
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Number  of  Times  Behavior  was  Performed 


Team  Frequency  Plot 


Behavior  Directed Toward:  6 

[IDispatch 
HI  Injured  Victim 
HB Other  Officer 
■Perpetrator 
E^StudentfStaff 
■Team  Member 
□  UnknownfUni  dentified 
■Weapon 
■Whole  Team 
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Number  of  Times  Behavior  was  Performed 


Individual  Frequency  Plot 


Behavior  Directed  Toward:  6 

[M  Dispatch 
^Injured  Victim 
ED  Other  Officer 
H  Perpetrator 
B  Stud  ant/Staff 
■Team  Member 
□  U  nkno  wn/Uni  d  e  nti  f  i  ed 
■Weapon 
■Whole  Team 
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Number  of  Seconds  Behavior  was  Performed 


Individual  Duration  Plot 


US.  ARMY  ' 

RDECOM 


BehaviorDirected  Toward: 

0  Dispatch 
^Injured  Victim 
EO  Other  Officer 
■Perpetrator 
StudentfStaff 
■Team  Member 
□  UnknownfUni  dentified 
■Weapon 
■Whole  Team 
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Behavior  Summary  Table 


US.  ARMY  ' 

RDECOM 


Officers 

Observations 

Behaviors 

Modifiers 

Duration  (s) 

Count 

Officer  2 

Officer  2 

Building  Approach 

Talk  out  Loud 

Dispatch 

1.5 

1 

Officer  2 

Building  Approach 

Talk  out  Loud 

Team  Member 

1.4 

1 

Officer  2 

Building  Approach 

Talk  out  Loud 

Whole  Team 

4.8 

2 

Officer  2 

Hallway  from  Entry  to  Auditorium 

Talk  out  Loud 

Student/Staff 

0.5 

1 

Officer  2 

Hallway  from  Entry  to  Auditorium 

Talk  out  Loud 

Team  Member 

1.9 

1 

Officer  2 

Hallway  from  Entry  to  Auditorium 

Talk  out  Loud 

Whole  Team 

3.0 

1 

Officer  2 

Auditorium 

Talk  out  Loud 

Whole  Team 

1.8 

1 

Officer  2 

Hallway  from  Auditorium  to  Library 

Talk  out  Loud 

Team  Member 

1.9 

1 

Officer  2 

Hallway  from  Auditorium  to  Library 

Talk  out  Loud 

Whole  Team 

8.9 

4 

Officer  2 

Hallway  from  Auditorium  to  Library 

firing  a  Weapon 

Hostage 

N/A 

1 

Officer  2 

Library 

Talk  out  Loud 

Team  Member 

1.3 

1 

Officer  2 

Library 

firing  a  Weapon 

Perpetrator 

N/A 

5 

Officer  2 

Hallway  from  Library  to  Gym 

Talk  out  Loud 

Team  Member 

5.5 

5 

Officer  2 

Hallway  from  Library  to  Gym 

Talk  out  Loud 

Whole  Team 

11.2 

3 

Officer  2 

Gym 

Talk  out  Loud 

Team  Member 

9.3 

2 

Officer  2 

Cafeteria 

Talk  out  Loud 

Team  Member 

24.1 

16 

Officer  2 

Cafeteria 

Talk  out  Loud 

Whole  Team 

4.0 

2 

Officer  2 

Cafeteria 

Talk  into  Radio 

Dispatch 

10.1 

3 

Officer  2 

Cafeteria 

Using  Hand  Signals 

Team  Member 

3.6 

2 

Officer  2 

Cafeteria 

firing  a  Weapon 

Perpetrator 

N/A 

8 

Officer  2 

Hallway  from  Cafeteria  to  Second  floor 

Talk  out  Loud 

Injured  Victim 

4.5 

1 

Officer  2 

Hallway  from  Cafeteria  to  Second  floor 

Talk  out  Loud 

Team  Member 

58.0 

14 

Officer  2 

Hallway  from  Cafeteria  to  Second  floor 

Using  Hand  Signals 

Team  Member 

3.1 

2 

Officer  2 

Hostage  Room 

Talk  out  Loud 

Perpetrator 

2.5 

2 

Officer  2 

Hostage  Room 

Talk  out  Loud 

Team  Member 

17.3 

5 
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